Some Properties of a Classic 
Numerical Integration Formula 

By I. W. SANDBERG 

(Manuscript received May 19, 1967) 

The numerical integration formula 

y*+\ = £ a *-?/--*- + * 2 &#»-* W = p (i) 

ft-0 t=-l 

ca?i 6e wsed to obtain a numerical solution of the system of nonlinear 
differential equations 

•<; + /(.r, /) = 0, / £ [.r(0) = *,]. (2) 

In many instances, it is known beforehand that the solution of (2) possesses 
a particular property such as boundedness or asymptotic periodicity with 
a given period, and it is then of interest to analytically determine the range 
of values of the step size h such that the sequence {y n } defined by (1) exhibits 
(at least) that property. In this paper, we consider problems of this type 
[but do not actually use assumptions concerning the character of the solution 
of (2)], and we study also the overall effect of solving instead of (1) the 
equation 

*.+, = Z a*2»-* + h J2 &*£-* + Rn , n ^ p 

*-ll km — 1 

which takes into account the effect of local roundoff errors and errors in 
the starting values. We consider explicitly only the case in which x(t) is 
scalar valued. 

I. INTRODUCTION 

In this paper, we present some theorems concerning properties of 
the classic numerical integration formula 1 

V V 

Vn*x = H ctkVn-k + h X Wn-k n^p (1) 

k-a *— — 1 

2061 
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a formula which can be used to obtain a numerical solution of the set 
of first-order nonlinear differential equations 

x + f(x, t) = 0, t^O [x(0) = Xo\. (2) 

In (1) the y„ are approximations to the x n = x(nh), where h, a positive 
number, is the step-size parameter; y , Vi , • • • , y P are starting vectors, 
the last p of which are obtained by an independent method; and 

y' n = -Ky n ,nh). 

Specializations of (1) include, for example, Euler's method: 

ft+1 = Vn + %n , ( 3 ) 

and the more useful formula 

*+i = 2/ n + l%^ + 2/n +1 ). (4) 

In many instances it is known beforehand that the solution of (2) 
possesses a particular property such as boundedness or asymptotic 
periodicity with a given period, and it is then of interest to analytically 
determine the range (or ranges) of step sizes that will lead to a se- 
quence {y n } which exhibits (at least) that property. This is one type of 
problem that we consider. For related material concerned with the 
overall effect of local truncation errors, see Ref. 2. Our results dealing 
with questions of asymptotic periodicity of the y n are restricted to 
cases in which the basic period is a multiple of the step size h. How- 
ever, it is often reasonable to choose h in this way to reduce program- 
ming complexity. 

In addition to the fact that the solution of (1) differs from the sam- 
ples of the solution of (2) due to truncation effects, 1 - 3 the problem of 
solving (2) is further complicated by the fact that the numbers ob- 
tained from the computer differ from the y n of (1) as a result of round- 
off errors. The local roundoff error R n introduced in calculating y n+1 
can be taken into account 1 by replacing (1) by 



Vn< 



v w 

= £ a*//.,-* + h 2 h kV«-k + Rn , n ^ p. (5) 



If b-i 9± 0, the error in solving (1) for y n+1 , caused typically by trunca- 
ting an iteration procedure 1,3 after a finite number of steps, can be 
accounted for by redefining R n . The second type of problem that we 
treat is to bound (from below as well as from above) a measure of the 
overall error in solving (5) instead of (1). The problem of estimating 
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the R n before the calculations are performed is by no means trivial, and 
is not considered here. On the other hand, since there exist methods for 
bounding R n given y k for (n — p) £ k ^ n (see, for example, Wilkinson 4 , 
for bounds on the effect of roundoff in forming sums, products, etc.), 
our results suggest the feasibility of programming the computer to 
evaluate overall error bounds as the calculation of the successive 
i/„,i proceeds. 

We shall explicitly consider only the case in which x(t) and the y n 
are scalars. Without much difficulty, each of the theorems can be ex- 
tended to cover the vector case. In this extension, requirements on, for 
example, the derivative d/(.r, t)/dx are replaced by conditions on the 
Jacobian matrix of f(x, t) (see Ref. 2) . 

For reasons that will become clear to the reader, our theorems are 
quite naturally characterized as "frequency-domain" results. Some of 
these theorems are close relatives of earlier results concerned with the 
input-output stability of nonlinear feedback systems* (see Ref. 5 
and the difference-equation theorems stated without proof of Ref. 6) . 
To the writer's knowledge, the only even remotely related material 
concerning (1) in the numerical-analysis literature, with the exception 
of Ref. 2, is Hamming's transfer-function approach. 3 

II. RESULTSf 

We begin by introducing some definitions and assumptions. We as- 
sume throughout this section that y„ and f(y„, nh) are real-valued 
scalars. 

Let a and be two real constants, let a_, = 0, and let 

F{z) ± 1 - £ [a k - §(« + 0ttdT w+ " (6) 

k— i 

for all complex 2^0. 

Assumption 1: It is assumed throughout that 1 -f- \(a + 0)hb-i t* 0, 

and that F(z) ^ for all | z \ ^ 1. 

This assumption implies that the sequence of approximations defined 

by (1) is bounded and approaches zero as n —* =o for all sets of starting 

values when f(x, t) = \{a + (3)x. 



* The usual frequency-domain nonlinear system stability results such as 
Popov's criterion 7 are not directly related because they do not deal with systems 
subjected to external inputs. 

t The proofs of the theorems stated here are given in Section III. 
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Definitions 

£ b k exp [-i(k + 1>] 



(i) P 4 J(/3 - «)A max 



F(e ( ") 
(»")• ' I Zl*-I a < " 

/„ = Ms,,} | sup I s„ I < oo J 

ngll 

[Hi)* Let K be a positive integer, and let 

X = | M | s„ = w + . forn - 0, ±1, ±2, • • ■ } 

E^exp|_- K + l 



(iv) pa = J08 - «)/»• max 



't-GM. 



in which (R = {0, 1,2, ••• , K}. 

2.1 Properties of (1) 
Theorem 1: If 

V v 

fc-0 A = -l 

i/ p < 1, and t'/ 

a < /(u.wA)-/(0,nA) n ^ Q 

w 

jor all real «^0, Men 

(0 {/(0, n/i)) c Z a implies that (//„) e Z 3 
(ii) i/(0, n/i) } t Z M implies that {y n } e l x . 

Remarks: 

The condition that p < 1 is satisfied if and only if the locus of 

2 a k exp (iku) — exp (— iu) 

0( w ) 4 1=2 

X! &t exp (tA-w) 



(7) 



* We consider only real sequences. 
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for ^ co ^ 2ir lies outside the "critical circle" C of radius \{fi — a)h 
centered in the complex plane at [\(a + 0)h, 0] (see Fig. 1). 

For Euler's formula (3), we have F(z) = 1 - [1 - $(a + 0)h]z~\ so 
that F(z) j* for | z | ^ 1 if and only if < \{a + /3)/i < 2. For this 
formula the locus of © is the circle shown in Fig. 2, since 0(to) = 1 — 
e~ ,a . If ah > and /3/i < 2, then the critical disk (Fig. 2) is not in- 
tersected by the locus of 0, the condition that < \(a + 0)h < 2 is 
satisfied, and p < 1. Concerning the necessity of the condition p < 1, 
we note that if ah > 0, but 0h > 2, then for even the special case in 
which f(x, t) = /3x, we have y , l/i , y 2 , • •• unbounded (assuming 
merely that y t± 0). 

For the formula (4) : 



F(z) = l+i(« + p)h - [1 - }(« + fiW 



and 



0(«) = 



1 - c 



|(1 + i- 



-«2*tan^ 



We have 1 + \{a + /3)/i ^ and F(z) ^ for | 2 | ^ 1 if and only 
if (a + ff)h > 0. The locus of lies entirely on the imaginary axis of 
the complex plane, 



P = 



/3 + <* ' 



and obviously p < 1 if a > 0. On the other hand, if a < 0, then for 
even the special case j(x, t) = ax : y Q , y x , • • • is unbounded provided 
that y 9^ 0. 

The following theorem is concerned with conditions under which 




ah /3h 

Fig. 1 — Location of the critical circle C. 
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Fig. 2 — The locus of ®(o>) For Euler's method, and the critical circle C. 

asymptotically periodic /(0, nh) in (1) implies that {y n \ is asymptotically 
periodic with the same period as that of /(0, nh). 

Theorem 2: If 

Z/, 1+ . = E o*2/»-t -AE b k f[y n - k , (n - k)h], n^p 

»/ p < 1, »/ [/(«, nfc) - /(0, n/i)] = [/(«, (n + K + l)/i) - /(0, (n + 
/C + l)h)] for all real u and n ^ 0, i/ 

a ^ ^^ S /8, n £ 

/or atf real u, and if there exists a y* e 3Z such that [/(0, nh) — y*] 1 1 2 , then 
there exists a y* b t 3C such that 

(t) (y - y*) t h 
(u) y* b is independent of [/(0, nh) — y*]. 

Remarks: 

In many cases of interest [j(u, nh) - /(0, nh)] is independent of n, 
and hence certainly satisfies the periodicity requirement. 

Theorem 3, below, provides a condition under which the sequence 
{y n \ of (1) cannot approach a "self sustained" limit cycle with period 
(K + 1). 

Theorem 3: If 

V P 

y n+ i = £ afln-k -^Z f[y«-k , (n - k)h], n^p 
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if \}(u, nh) - /(0, nh] = [f(u, (n + K + i)h) - /(0, (n + K + l)/0] /or 
ai/ rea£ n and n ^ 0, if 

a S #%^ S 0, ,SO 

/or aZ£ real u, if /(0, n/i) — > as n — > co , and i'/ Mere e.ris<s a y* e 3C dt"/- 
/erentf /rom, tfie zero element of 3C snc/i that (y n — y*) — » as n — ► «> , 
Men pjc ^ 1. 

i?ewiarfc: 

For px ^ 1, at least one of the complex numbers 

must lie on or within the circle C of Fig. 1. 

2.2 Results Concerning the Effect of R n and Errors in the Starting Values 

Theorem 4, below, is essentially the same as a result concerning the 
effect of local roundoff and truncation errors proved in Ref. 2. The proof 
of Theorem 4 given in Section III is considerably more direct than the 
corresponding argument of Ref. 2. 

Definition: 

for all N ^ and every sequence { s„ | . 
Theorem 4: If 

V V 

2/n + i = 2 a k y n - k - h 2 Mil/-* , (n - fc)/i], n ^ p 

4=0 1--1 

P P 

z n+ i = 2 a***-* -^Z Mfr.-* . (n - k)h] + R n , n ^ p 

*-0 t--l 

if 

a < ^%^ £ 0, n ^ 

/or all real u, then for all N ^ 0: 
(i) (y - z) N ^ (1 + p)" 1 min | F(e iu ) \~ l (+)„ , 

OSo.S2t 
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and 
(ii) if p < 1, 

(y - z) N £ (1 - p)- max | Ftf*) \~ l <*>, 

0S«S2» 

in ivhich 

*„ = -fl„_i , n ^ (p + 1) 

p 

= fan — 2») — S a*(?/n-*-l - Zn-*-l) 
fc-0 

+ A Z Mfl»-»-i , fa - fc - DA] - /&-*-, , (n - * - 1)*]}, 

to = 0, 1, 2, ••• , p 
with y n = /(y„ , nh) = z n = f(z n , nh) = /or to < 0. 

Ref. 2 considers two simple examples concerning the evaluation of 
the numbers 

(1 + p)" 1 min | F(e iu ) \~ l and (1 - p)" 1 max | F(e ia ) p 1 . 

Since 

p = 1(0 _ «)/! {min | 0(a>) - K« + 0)h |}~\ 

we see that p is the ratio of the radius of the circle C of Fig. 1 to the 
distance between c and 6, where c is the center of C and is a point 
nearest c on the locus of @(w). 

The following corollary provides asymptotic bounds on the difference 
between the solutions of (1) and (5) when the solution {y n \ of (1) is, 
for example, asymptotically periodic. 

Corollary to Theorem 4-' // 

k-0 k— 1 

a/(u, n/Q 
« ^ — - — s p 

du 
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fur all real u and n ^ 0, if there exists a sequence y such that (y n — y„) — > 
as n — * «o , and if 

Zn + i = Z «*«»-* ~ h Z b k f[z n - k , (n - k)h] + R n , n £ p. 
77; en 

( 2 - y) N * (1 + p)" 1 min | F(e'") |- (iA).v - | 7.v I 

0S«S2x 

with q N —* as N — > « , 
and 

(w) t'/ p < 1, 

(^ - ft, ^ (1 - p)" 1 max | F(e ia ) I" 1 <«A>^ + | r v | 

0SuS2x 

with Tn — » as AT — > oo 

in which 

4> n = Rn-i , n > (p + 1) 

= 0, n = 0, 1, 2, ••• , p. 

Remark: 

Note that the lower bound is valid under quite weak assumptions. 

III. PROOFS 

We first prove the following lemma which plays a role in the proofs 
of all of the theorems 

Lemma 1: If 

l/-+i = 2 akVn-k — h 2l b k 1[y«-k . (w - k)h] + fl» , n ^ p 

t-0 fc— I 

Men 

2/n = E «» B _^(j/* , kh) + S w „- t /(0, kh) + £ *,_** , n > 

in w/tic/i {iu„} and {v„} are the inverse z-transforms of 

-h £ b*-™ 



W(z) A 



1 - £ [a. - |(a + 0)hbkK (k+1) 
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and 

V(z) 4 l - , 

i - Z K - *(« + P)hbk\r <k * l} 

i--l 

respectively; 

oo oo 

2 1 w * I < °° • Z I »« I < °° . 

n-0 n-0 

p(y* , &*) = /(y* , m - no, kh) - |(a + 0y» , 

and 

<p n = R n ., , n ^ (p + 1) 

p p 

= 2/n - £ UkVn-k-l +/» E &J[?/n-*-l , fa ~ & — l)ft] . 

4-0 4 = -l 

n = 0, 1, 2, • •• ,/} 

m'£/i ?/ n = }(y n , n/t) = Oforn < 0. 

Proo/ o/ Lemma 1 : 

From 

p p 

V»+i = Z o*y»-t -*E b k f[y n - k , fa - fc)fc] + R„ , n^p 

A-0 4--1 

we have 

V 

Vn = 2Z UkVn-k-X 
*-0 

- h E &i/lk-*-i , fa - /c - l)/t] + «„-, , n £ (p + 1) 

and, with the v? n as denned in the lemma, 

p p 

4 1 t 1 

where 

** = /fa* , kh) - |(a + ;%* . 

Let Af > 0. Then ?/„ = # n for n = 0, 1, ■ ■ ■ , M, in which 

p p 

ti, = Z [a* - K« + &)hb k }y n - k - x -*£ Mn-*-i + ft, , n £ 0, 

4--1 4--1 
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where 



S n = 8 n for n ^ M 

= for n > M, 

<p n = <Pn for n ^ 71/ 

= for n > M, 



and 



y n = KD» ,nh) = Q for n < 0. 
It is clear that {<£„}, {$„}, and {?/„} are ^-transformable. Let 

and 

n-0 

Then 



[-2 

L fc— i 

Therefore, 

Y(z) = 



[a k - K« + 0)hb k ]i 



Y(z) 



= -h £ &^" ( * +1) A(2) + *(z). 



-A 2 b^-"* 1 ' 



1 ~ Z [a k ~ *(« + 0*M»" 

k — i 

+ 



AW 



m 



k=~i 

and, with jw,) and {i>„} the inverse 2-transform of W(z) and V(z), 
respectively,* we have 

y n = S ">„_*£* + 2 y B -*$* . w ^ 



* Recall that W(z) and V(z) arc donned in Lemma 1. 
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with (in view of Assumption 1) 

00 00 

^2 I w„ I < co , and 2l I w * I < °° ■ ( 8 ) 

n-0 n-0 

Thus, 

Vn = £ Wn-k&k + J^ V n-k<Pk (9) 

k-0 *-o 

for n = 0, 1, 2, • • ■ , M. Since M is arbitrary, (9) is satisfied for all 
n ^ 0. Finally, with 

0(2/* . kh) A /(y 4 , fcfc) - /(0, fcfc) - J(« + /%* 
2/n = S w-tf(v» . /c/i ) + S w-*/(0, **) + Z v n-m , n ^ 0. 

jfelo * = o *-° 

We now prove a lemma which is used in the proofs of most of the 
theorems. We repeat the 

Definition: 

for all iV ^ and every sequence [s n \. 
Lemma 2: If 

y n = £ w„- k a(k)y k + b„ , n ^ 

k = 

and if -§(/3 - a) ^ a(k) g |(/3 - a) for all k ^ 0, Men 

» <2/),v ^ (1 + p)- 1 (b)„foiN ^ 0, 
and 

(u) if p < 1, Men <i/> jV ^ (1 - p)~ l <&>* for tf ^ 0. 
P?-oo/ o/ Lemma 2: 

Let 

?» = 2 w n - k a(k)y k , n ^ 0. 
*-o 

By Minkowski's inequality, 

(V)* ^ (qh + (V>* (10) 
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and 

(b) N ^ (!,),■ + (q) x . (11) 

Lemma 2 follows from (10), (11), and the inequality" 

('i)x ^ p(y)x ■ 

3.1 Proof of Theorem 1: 
By Lemma 1, we have 

?/„ = Z u> n - k g(y k , kh) + Z w n . k f(0, kh) + Z «„_**>* , » ^ 

1=0 A— II t-0 

with (because R n = for all n ^ p) <p„ = for all n ^ (p + 1). 
Let 

b n = E ">„-*/((), fc&) + E^-m . n ^ 0. 

*-0 *-0 

Since both [w n \ and {v„} belong to /, [i.e., since (S) is satisfied], b t L 
if {/(0, M) 1 t l 2 and 6 e L if {/(0, fcfc) |ei». 
Suppose that b tl 2 , and let 

^.B&LiM, for ,,,.0 

= 0, for //, = 0. 

The function o(&) satisfies the bounds of Lemma 2, and 

y n = Z «*»-*«(%* + k - n ^ (12) 

fc-o 

Therefore, by Lemma 2, 

z i ?y„ i'-' ^ a - p)" l ' z i &„ p ^ (i - p) -2 z i &- i a 

,,-n n-n n-0 

for all A' ^ 0, from which it is clear that y t l 2 . 

If b t l K , then \y„\ satisfies (12) with b t l„ . According to the first 
conclusion of the following lemma, this implies that y zl m . 

Lemma 3: If 

//„ = Z Wn-Mfyjk + l>n , n ^ 

1=11 

with btl K ,if p < I, and if -£(/3 - a) ^ a (ft) £ \{fl - a) for all k ^ 0, 

then 
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(i) y e i» 
(ii) there exists a constant c M , which depends on only the a k , the b k , a, 

and /3 such that 

sup | y n | ^ Co sup | b n | . 

ngO nfcO 

Proof oj Lemma 3: 

The proof is essentially the same as that of the second part of Theorem 
2 of Ref. 2. The details are omitted.* 

3.2 Proof of Theorem 2 

Definitions: Let X denote the set of all real sequences {s n } such 
that s n = s n+A + 1 for all n = 0, ±1, ±2, ■ • • , and let <R = {0, 1, 
2, •..,*}. 

Lemma 4.: Let g*(x, nh) be defined for all real x and all n = 0, ±1, 
±2, • • • , swcft tfia«: g*(x, nh) = g*[x, (n + K + l)/t] /or att a; and n, and 

-103 - a) s &!&»*l a «* - «) 

/or aM x and n. If p t X and i/ /?* < 1, then X contains exactly one element 
y* such that 

y* = E u>n-,,g*(VH . hh) + p„ 

A: =-00 

fom = 0, ±1, ±2, ••• . 

Proof of Lemma 4 : 
With the norm 

11 11 a I Vk 

the set X is a Banach space. The operator WG denned on X by 
(WGs) n = £ ivn-xg*(s k ,kh), szX 

A." =--00 

maps X into itself. By the contraction-mapping fixed-point theorem, 
it suffices to show that WG is a contraction when p K < 1. It is clear that 

|| WGs a - WGs b || ^ || W 11-11 Gs* - #«» II 

^ K/3-«) || W\\-\\s a -s b || 

for all s„ e X and all s b t X. 
* See also Ref. 6. 
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If s t JC, then 

s* = £$, exp ^ * J for fc = 0, ±1, ±2, 



in which 



and 



Thus, if 



i, - (A"+ I)" 1 E«„ 



exp 



■i' 2irht. 
K+ 1 



£ i s „ r = (x + 1) e 1 1. 1 2 . 



m, = 2 uu-t«* for n = 0, dbl, ±2, ••■ 



with s e 5C, we find that 



u n = 2 *r„_, X S, exp . 

fc— oo 1-0 \' v "T i 



/2tt//,- 

r v + J 
i2irZ& 



K oo 

= Di I w, - k Qxp [k~"+i) (; °' " n) 



i2rln 



./' cxp U+TJS u '" exp l-^TT 



t2r&i 



K 



Therefore, since 



/2tt/ 



?i exp 



i' 2-Tvln 
K + 1 



m || = || Ws || ^ max | IT' 



exp 



J2^_\l 
K + l/J 



8 . 



we have 



W || ^ max 



ir 



exp ,. 



i'1-wq 



K + l/_ 



and || WGs a — WGs b || ^ p K \\ s a — s b || for all s a t 3C and all s 6 t 3C. 
This completes the proof of Lemma 4. 
By Lemma 1, 



y, t = Z w n -k9(yk , hh) + 2 w-*/(0. M) + £ "»-*¥>* , n ^ 
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with <p k = for fc £ (p + 1). Here, since both [w n ] and [v n ] belong to 
l t , we have 

E «\.-*/(0, A*) + E »*-*** = P. + c„ , n ^ 

ft = ft = 

with p c 3C and c e Z 9 . In fact, with y* as defined in Theorem 2, 
p. - E «r-tf&, n = 0,±1, ±2, ••• . 

ft 00 

Let 0*(z, n/0 be defined by the conditions: 0*(s, nh) = <7*[x, (w + 
K + l)/i] for all x and n = 0, ±1, ±2, • • • , and p*(s, n/i) = g(x, nh) 
for all x and n = 0, 1, • • • , K. Then, since p K ^ p < 1, by Lemma 
4 there exists a ?/t e 3C such that 

?/6* n = E w*-*9*(yt* . **) + P- 

ft = - 00 

for n ^ 0. Therefore, 

Vn - V& = E u>n-k[g*(y* , m - g*(y b % , kh)} + <*» , n ^ o 

ft-0 

in which 

<*. =c„- E w n ^g*(y b * k ,kh), n £ 0. 

ft = -oo 

But 



I 

ft --00 



E w n -hg*(y*k , kh) 



^ sup I <7*(?/ b * , n/t) | E I «>»-* 



and, using the fact that there exist constants y > and f > such that 
| m>„ | ^ ?; exp ( — fn) for n ^ 0, 

-1 =0 » 

E I ^-ft ! = E I w» I ^ i? exp [-f(w + 1)] E exp (-fm). 



*■ 00 

We see that 



E w n - k g*(y*k , kh) 1 1 , 



and consequently d tl 2 . 
Let 

M g*(?/ft , fcft) - g*Q/„t , fc/fl , 

fc) = Z , i/ft r* II hk 

Vk - y*k 



aw 



= 



z/fc = ySL 
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Then -J(/3 - a) ^ a(k) £ $(/3 - a), and 

n 

V« - y* = 2 Wn-ka(k)(y k - y&) + d n , n ^ 0. 

By Lemma 2, we have (?/ — y* h ) t l 2 , and since it is clear that y\ depends 
on y* , but not on [/(0, nh) — y*], this completes the proof of Theorem 2. 

3.3 Proof of Theorem 8 

We need the following lemma. 

Lemma 5: If y n = y* + *7 n tw'& ?/* c 3C and i}„ — » as n — » °o, z/ 
flf(x, fc/i) = ff[.t, (k + 7v + i)h] for all k ^ and a?/ x, if there exists a 
positive constant c such that \ g(u t , kh) — g{u 2 , kh) | ^ c | w, — u 2 \ for 
all real u x and u 2 and all k ^ 0, and if 

n 

?/- = Z W«-kg(Vk , kk) +Vn+ 8n , »l ^ 

fc-0 

with /> t K and 8„ — » as n —* w , Men 

?y* = £ ».-**<# , kh) + p B 

ft— 00 

/or all n = 0, ±1, ±2, • • • , in which g*(x, kh) is defined by the con- 
ditions: 

g*(x,kh) = g *[ x ,(h + K+ l)h] 
for all k and all x, and 

g*(x, kh) = g(x, kh) 
for all x and k = 0, 1, 2, • ■ ■ , K. 
Proof of Lemma 5: 
For n ^ 0: 

!J* + Vn - Z Mfc-tfW + ** . /•■/'] + Vn + «- 
Jt-0 

+ Vn + 5„ 

£ w._^*(yj , kh) + E »-*[0<# + v* , **) - g(yt , **)] 

*- = -00 A- = 

-1 
- S w,,- k g*(yf , kh) + p„ + S„ . 
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Therefore, 

yt ~ Z w n - k g*{yt , kh) - p n = ~v n 

fc--00 

+ Z v-tWtf + n* - **) " rtW • **)] 

k = (l 

Since {«•„} t {, , both sums on the right-side approach zero asw-> oo. 
Thus, the left side also approaches zero as n — > oo . But the values of 
the left side are periodic. Therefore, 

y* - Z *,-**<# , WO - p. = (13) 

A- = - M 

for all n ^ 0, and since y* e X and p e JC, (13) holds for all n. This proves 
Lemma 5. 
By Lemma 1, 

y n = Z w n - k g(y k , kh) + E w„_*/(0, M) + Z i/„-tf>, , n £ 

a=o *=o *-o 

in which </(?/, ; , fc/i) is denned in Lemma 1, and <p k = for k ^ (p + 1). 
Since {iv n \ and [v n \ c /, , and /(0, M) -> as k — > w, we have 

£ u>„_*/(0, to) + E v n .m -> as n -> « . 

fc-0 A = 

By Lemma 5 and the hypotheses of Theorem 3, 

y* = Z v>«-*9*(yt . **) 

for n = 0, ±1, ±2, • • • , with y* e 3C. If p K were less than unity, it 
would follow from Lemma 4 (in particular the uniqueness property 
of y* of Lemma 4) that y* = for all n, since g*(0, kh) = for all 
k ^ 0. Therefore, p K ^ 1, which completes the proof of Theorem 3. 

3.4 Proof of Theorem Jf.: 
According to Lemma 1, 

n n 

y. - z n = E w»-*[(7(y* , A70 - ?(** , kh)) + Z ».-*** . » ^ 0. 

A- = * = " 

Therefore, with 
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b n = £ r„_,^, , n ^ 
we have, by Lemma 2, 

(?/ - t>» & a + P y\b),. 

and if p < 1 , 

(U ~ z) N £ (1 - p)" 1 ^ . 
Since 2 

<6). v ^ max | f(«'-) |- <*>. v , 

OS«S2x 

it remains only to prove the following lemma. f 
Lemma 6: If 

d n = £ v n . k c k , n^O 
*-o 

then 



<r/>.v ^ min | F(e ia ) \~ l (c) N . 

OSuS2t 



Proof: 



Let {e 4 } be the inverse z-transform of V \z). Clearly, {e*} t l x . We 
have 

£ e„_ m tf m = £ «»-»• I] "m-*Ct = c n for n ^ 0. 

m-0 m=0 *=0 

Thus, 2 

(c)* ^ max | F" ] (0 | (d) N 



and, since F(z) - V~\z), 

(d) s ^ ( max | F(e iu ) \y l (c) x 

^ min | F(e ia ) |"' <r). v 

which proves Lemma 6, and completes the proof of Theorem 4. 

3.5 f-Yoo/ o/ the Corollary to Theorem 4 
Minkowski's inequality. 
t Lemma 6 is proved in Ref. 2. The proof given here is simpler 
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